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DISTRIBUTED RESOURCE ARCHITECTURE AND SYSTEM 



TECHNICAL FIELD OF THE INVENTION 

[0001] The present invention relates generally to the field of computer 

systems, and more particularly to a distributed resource architecture and system. 

BACKGROUND OF THE INVENTION 

[0002] In the days when mainframe computers and super computers 

dominated the digital landscape, users were typically given slices of computing time from a 
fixed pool so that the computer worked on many jobs in parallel. Users interfaced with the 
mainframe computers using "dumb terminals" connected to the mainframe computers and 
simple command line user interface. However, the computing environment gradually shifted 
to lower-cost personal computers and workstations, which offered users greater control of 
how their applications executed and a better, more intuitive graphical user interface. More 
recently however, with the global connectivity provided by the Internet and faster 
bandwidths, there has been another shift toward simplified or stripped-down computers or 
appliances connected with the distributed data storage and computing resources provided by 
"web farms" via the Internet. Web farms are typically clusters of servers, microcomputers 
and mainframe computers that currently perform mostly web server and hosting function for 
web applications and web pages. 

[0003] In the computer graphics domain, current computer graphical 

visualization systems may employ a cluster of workstations or personal computers executing 
a graphics application and working simultaneously on a single job to render an image to be 
displayed on a display device. The image is displayed as a single logical image on a single 
monitor screen or across multiple monitor screens. Such visualization systems may use a 
plurality of graphics pipelines to render different portions of an image for display on the 
display monitor to speed up processing time and improve the quality of the displayed image. 
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SUMMARY OF THE INVENTION 

[0004] In accordance with an embodiment of the present invention, a 

distributed resource system comprises a plurality of compute resource units operable to 
execute graphics applications and generate graphics data, and a plurality of visualization 
resource units communicatively coupled to the plurality of compute resource units and 
operable to render pixel data from the graphics data. A first network couples a network 
compositor to the plurality of visualization resource units. The network compositor is 
operable to synchronize the received pixel data from the plurality of visualization resource 
units and receive the pixel data from the visualization resource units and to composite the 
sunchronized pixel data into at least one image. A plurality of display devices, at least one of 
which is located remotely from the plurality of compute resource units, are coupled to the 
network compositor and operable to display the at least one image. 

[0005] In accordance with another embodiment of the invention, a distributed 

resource system comprises a plurality of distributed first resource units operable to generate a 
first set of data, a plurality of second resource units operable to generate a second set of data 
in response to the first set of data. A traffic controller located remotely from at least one of 
the plurality of second resource units is communicatively coupled to the plurality of second 
resource units and operable to collect the second set of data from the plurality of second 
resource units and synchronize the collected data. A plurality of display devices is coupled to 
the traffic controller and operable to receive the synchronized data for display to a plurality of 
users. 

[0006] In accordance with yet another embodiment of the present invention, a 

distributed resource system comprises a plurality of first resource means executing at least 
one computer application and generating a plurality of first data, a plurality of second 
resource means coupled to the plurality of first resource means for generating a plurality of 
second data from the plurality of first data received from the plurality of first resource means, 
and controller means coupled to the plurality of second resource means for receiving the 
plurality of second data therefrom and operable to synchronize and composite the plurality of 
second data. Display means are coupled to the controller means for receiving and displaying 
the synchronized and composited data therefrom. 

[0007] In accordance with another embodiment of the present invention, a 

distributed resource graphics processing method comprises generating a plurality of sets of 



100110664-1 




graphics data at geographically disparate locations, rendering the sets of graphics data and 
generating a plurality of sets rendered pixel data, receiving the plurality of sets of rendered 
pixel data, synchronizing the plurality of sets of pixel data for an image frame from different 
sources and compositing pixel data associated with the same image frames into at least one 
image, and displaying the at least one image. 

[0008] In accordance with a further embodiment of the present invention, a 

distributed graphics visualization architecture comprises a plurality of compute resource 
units, a plurality of graphics pipelines coupled to the plurality of compute resource units, and 
a plurality of local compositors coupled to the plurality of graphics pipelines. A network 
compositor is communicatively coupled to the plurality of local compositors via a network 
and is operable to synchronize and composite graphics data received from the plurality of 
local compositors into at least one graphical image. A plurality of display devices are 
coupled to the network compositors and are operable to receive and display the at least one 
graphical image. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] For a more complete understanding of the present invention, the 

objects and advantages thereof, reference is now made to the following descriptions taken in 
connection with the accompanying drawings in which: 

[0010] FIGURE 1 is a simplified functional block diagram of an embodiment 

of a distributed resource architecture and system according to the teachings of the present 
invention; 

[0011] FIGURE 2 is a simplified block diagram of an embodiment of a 

distributed resource architecture and system for graphics visualization according to the 
teachings of the present invention; 

[0012] FIGURE 3 is a more detailed block diagram of an embodiment of a 

distributed resource architecture and system for graphics visualization using a network 
compositor according to the teachings of the present invention; 

[0013] FIGURE 4 is a simplified block diagram of an embodiment of a 

visualization resource; and 

[0014] FIGURE 5 is a flowchart of a network graphic composite process for 

processing graphics data according to an embodiment of the present invention. 
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DETAILED DESCRIPTION OF THE DRAWINGS 

[0015] The preferred embodiment of the present invention and its advantages 

are best understood by referring to FIGURES 1 through 5 of the drawings, like numerals 
being used for like and corresponding parts of the various drawings. 

[0016] Current computer graphical visualization systems such as Hewlett- 

Packard Company's Visualization Center sv6 (HP sv6) typically employ a cluster of 
workstations and visualization resources processing and rendering a single graphical image to 
be displayed as a single image. HP sv6 is described in U.S. Patent Application, Serial No. 
09/715,335, entitled, "SYSTEM AND METHOD FOR EFFICIENTLY RENDERING 
GRAPHICAL DATA," filed on November 17, 2000. 

[0017] FIGURE 1 is a simplified functional block diagram of an embodiment 

of a system 10 constructed according to the distributed resource architecture of the present 
invention. System 10 employs distributed resources 12, which may be geographically 
distributed across the globe and may comprise data storage building blocks 14, computing 
resource building blocks 16, and other resources. Each set of co-located building blocks may 
be implemented in a separate computing and/or storage device or data storage and computing 
resources may be embodied in a workstation, for example. As shown in FIGURE 2, 
distributed resources 12 comprise networked data storage devices 18, personal computers, 
workstations, servers and other computers 20, and visualization resources 40 that can be 
added to the configuration of computing resources or removed there from according to need. 
There need not be a one-to-one correspondence between the data storage devices, compute 
resources, and visualization resources, as more than one data storage device may be coupled 
to a single compute resource, and more than one visualization resource may be coupled to a 
single compute resource, for example. Software applications such as a graphics application 
are executed in computers 20 acting as host computers. Visualization resources 40 comprise 
graphics engines that are typically workstations that have components such as graphics 
pipelines 24 coupled to respective frame buffers 26, as shown in FIGURE 4. The output of 
frame buffers are coupled to a local compositor 28, that forms images with the pixel data 
received from the graphics engine. The graphics engine may include specialized hardware 
and software resources other than those shown in FIGURE 4 as known in the art. Graphics 
engines can range in complexity from a graphics card to an entire workstation. Inputs to 
graphics pipelines 24 of a graphic engine 22 are coupled to a network such as a local area 
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network (LAN) and are operable to receive graphical data from compute resource 16. 
Graphics pipelines 24 may be arranged to have a master pipeline and slave pipelines, for 
example. A frame buffer (FB) 26 is coupled to each graphics pipeline 24 and operable to 
store one or more frames of image or pixel data rendered by the respective graphics pipeline. 
The output of frame buffers 26 is rendered pixel data such as DVI (digital video interface) 
data. DVI data typically comprise the coordinate values of the pixel position to be displayed 
on the display screen, and the color values of the pixel. For example, DVI data may comprise 
the (X,Y) coordinate value of the pixel, RGB (red, green, blue), values. DVI data may 
further comprise a depth value for the pixel (Z), and a transparency value for the pixel (a), 
and other attributes. 

[0018] Returning to FIGURES 1 and 2, distributed resources 12 are coupled to 

user terminals or display devices 30 via networked data compositing resources 32. 
Networked data compositing resources 32 may comprise networks 34 such as a LAN, wide 
area network (WAN), intranet, extranet, Internet, or any other suitable network or 
connectivity, and components 36 for synchronizing, compositing and routing data. User 
terminals or display devices 30 are devices on which users may view the processed data and 
the results generated by distributed resources 12. Display devices 30 may employ any 
display technology now known or later developed. Preferably, user terminals and display 
devices 30 comprise user input entry devices such as keyboards and pointing devices, 
however such equipment may not be necessary for certain applications. 

[0019] According to the teachings of the present invention, all the processing 

and visualization functions are performed by distributed resources 12 so that distributed data 
created by geographically disparate users may remain where they are created, and only data 
associated with the processed result are conveyed to the user(s) who are viewing or using the 
results. In this manner, large volumes of raw data need not be transmitted over the network, 
which requires large network bandwidth and high transmission speed. For example in 
computer graphics applications, raw data generated by geographically distributed engineering 
design teams, for example vehicle exterior body designs and interior component designs, can 
remain in place and need not be transmitted to a central location for visualization rendering. 
Only rendered pixel data are transmitted over network 20 and composited to form the 
resultant 2D or 3D (two-dimensional or three-dimensional) images. The pixel or image data 
to be displayed to the user is usually several magnitudes less than the data needed to generate 
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the graphics images, so that the data transmission time is significantly shortened and the data 
storage requirement at the users' computer terminals is minimal. Furthermore, data storage 
can remain distributed and co-located with distributed users who created the data and who 
may continually modify and update the data. 

[0020] Unlike conventional systems, distributed system 10 is operable to 

allocate distributed resources 12 to one or more jobs simultaneously to generate one or more 
results to be displayed on the respective display devices. The allocation unit of the 
computing resources, for example, may be a CPU (central processing unit) and the allocation 
unit of the visualization resources, for example, may be a graphics pipeline and its associated 
hardware/software. A subset of storage, computing and rendering resources is allocated to 
each job or an execution of an application software for displaying results on a subset of 
display devices, so that distributed resource system 10 is operable to perform multiple jobs 
and execute multiple applications distributed over non-co-located resource components. 

[0021] FIGURE 3 is a more detailed functional block diagram of an 

embodiment of a distributed resource architecture and system 10 for graphics visualization 
according to the teachings of the present invention. Distributed resource architecture and 
system 10 comprises data storage devices 14 coupled to compute resources 16. Data storage 
devices 14 are preferably networked components to facilitate the transfer of data there 
between and to compute resources 16. Compute resources execute graphics applications for 
one or more "jobs" and queries and receives the data needed to generate graphics data from 
networked data storage devices 14. Compute resources 16 are further coupled to a plurality 
of visualization resources 40. Visualization resource 40 comprises graphics engine, frame 
buffers, local compositors and other graphics-specific hardware and software. 

[0022] Visualization resources 40 are coupled to a first network 42, which 

may be a LAN, WAN, intranet, extranet, Internet, or any other suitable network or 
connectivity using any number of suitable networking protocols including Ethernet, TCP/IP, 
and Infiniband now known or later developed. Network 42 may also be a combination of 
different types of networks. Graphics data are transmitted and routed by first network 42 to a 
network compositor 44. Network compositor 44 is a graphics compositor that is capable of 
putting the rendered graphics data together into one or more graphics images. Because of the 
distributed nature of system 10, network compositor 44 is further capable of handling data 
latency and synchronization issues that arise due to different distances, transmission speeds 
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and bandwidths in the network. Network compositor is capable of generating and sending 
feedback control data to the sending resources to slow down or throttle those resources whose 
transmission rate is significantly faster than that of other resources. Network compositor 44 
composites the images from pixel data received from the visualization resources and then 
sends them to display devices 30 via a second network 46. In most applications, second 
network 46 is a network for transmission of data over shorter distances, such as a LAN. 
However, second network 46 is not so limited and may be any one or combination of LAN, 
WAN, intranet, extranet, Internet, or any other suitable network or connectivity using any 
number of suitable networking protocols now known or later developed. 

[0023] In non-graphics specific applications, network compositor 44 may be 

thought of as a generic traffic controller that is operable to collect data that are more relevant 
to one another or data which should be displayed or processed together, and that is then 
operable to send the collected data to the specific display devices. Acting as a traffic 
controller, network element 44 is operable to synchronize and time the collected data, as 
described in more detail below. 

[0024] Referring to FIGURE 5, an embodiment for a process 50 for a network 

compositor dealing with data latency and synchronization is shown. In block 52, network 
compositor 44 (FIGURE 3) receives a data packet from each distributed resource 12. 
Network compositor 44 then decompresses, extracts and processes data from the data 
packets, as shown in block 54. This may involve stripping away network protocol headers 
and other extraneous data. Network compositor 44 may extract a frame identifier (ID) 
associated with each frame of data and determine a sequence for the frames, as shown in 
block 56. For example, network compositor 44 may know that frame ID = X is ahead in time 
of frame ID = X+l. Each packet of data also includes information related to the intended 
destination of the pixel data, so that network compositor 44 is able to create a composite of 
data packets from specified one or more subsets of resources. Network compositor 44 then 
provides a feedback to specific resources to throttle its transmission and processing speeds so 
that these resources do not significantly outpace other slower resources, as shown in block 
58. It may be seen that the feedback may be in the form of control data or messages sent by 
network compositor 44 to specified visualization resources 40 via network 42. The specified 
visualization resources may be identified by a destination address in the form of an identifier, 
for example, in the feedback message. Despite the ability to throttle and control the sending 
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speed of the visualization resources, network compositor 44 may still receive data that have 
arrived ahead of the current frame being sent for display and stores the data, as shown in 
block 60. Network compositor 44 may use look-ahead buffers to store the data while waiting 
for data for the same frame from the remaining resources. Network compositor 44 then 
composites the pixel data having the same frame ID or some other identifier that are intended 
for the same image frame, as shown in block 62. Data that have arrived earlier than 
scheduled may be read from the look-ahead buffers. The composited image is then sent to 
display devices 30 for display to the users via network 46 (FIGURE 3), as shown in block 64. 
The images may be displayed on several display devices over a geographically distributed 
region, or displayed over several display devices as one or more logic images. Network 
compositor thus updates the images displayed on the display devices continually. The 
network compositor process ends in block 66. 

[0025] In operation, compute resources 16 execute one or more computer 

applications or one or more instances of a computer application. The computer applications 
may be graphical applications used to render one or more graphical images. The graphical 
images may be displayed as one or more logical screens on one or more display devices. 
Compute resources 16 are geographically distributed from one another and are preferably 
respectively co-located with data storage devices storing data related to the images to be 
rendered. For example, teams of engineers are jointly working on the design of a new 
concept vehicle. The design team for vehicle engine design is located in City A, the design 
team for vehicle body exterior design is located in City B, the design team for vehicle interior 
design is located in City C, and the design team for the vehicle dash design is located in City 
D. The design review team for the vehicle is located in City E and would like to see the 
designs of the design teams displayed simultaneously on a number of display devices. The 
vehicle body exterior design is to be displayed as a single logical image over six physical 
screens; the vehicle interior design is to be displayed on a single display device; the engine 
design is to be displayed on two display devices; and the vehicle dash design is to be 
displayed on a single display device. Though the engine design team is located in City A, the 
team that performed the simulation of the engine moving components may be located in a 
different city, City F, and the design review team also requests to view the engine 
performance simulation images superimposed over the engine design images. In this 
scenario, network compositor 36 is required to receive pixel data received from 
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geographically disparate resources, composite the images and send the images to the 
specified display devices. Because some of the images, such as the vehicle exterior body 
design and the engine design, are not and need not be intimately related in timing, network 
compositor 36 does not need to control and throttle the sending rate between the respective 
sending resources. However, network compositor 36 may need to coordinate the engine 
design images and the engine simulation images and composite the data, thus throttling of the 
sending resources in this instance may be required. In this scenario the destination display 
devices are co-located, however this does not need to be the case and the destination display 
devices may be geographically distributed as well. 

[0026] Distributed resource system and architecture 10 may be used for 

generalized computing applications or specialized applications such as graphics and 
visualization. The resources can be located remotely from the users because only the results 
of the execution are transmitted over the network to reduce bandwidth requirements and 
transmit time. Therefore, the bulk of the data needed to generate the results remains where 
they were generated and are accessed on a more frequent basis. Each resource is operable to 
access data generally stored co-located therewith, generate the pixel data, and the network 
compositor is operable to composite the pixel data into one or more graphical images and 
deliver the images to the dedicated display devices. 



